MIDI Example Movie Video Mirror Feedback Movie Synth Music TV Audio Controller Script Computer Vision Camera
نویسندگان
چکیده
A prototype system for implementing a virtual Personal Aerobics Trainer (PAT) is presented. Unlike workout video tapes or TV exercise shows, this system allows the user to create and personalize an aerobics session to meet the user's needs and desires. Various media technology and computer vision algorithms are used to enhance the interaction of the character by enabling it to watch and talk to the user (instead of just the user watching the TV). Throughout the paper , we report the system components and discuss the advantages, problems, and extensions of the design.
منابع مشابه
A silence/noise/music/speech splitting algorithm
In this paper, we present techniques to warp audio data of a video movie on its movie script. In order to improve this script warping, a new algorithm has been developed to split audio data into silence, noise, music and speech segments without training step. This segments splitting uses multiple techniques such as voiced/unvoiced segmentation, pitch detection, pitch tracking, speaker and speec...
متن کاملInterÉlastique A system for control of an audio-visual experience using novel stretchable sensors
Interactive installations today typically limit the interaction by allowing only one active user at a time, and are commonly based on traditional forms of user input (i.e., keyboards, trackballs, touchscreens, etc.). This paper describes InterÉlastique, a system we have created that allows collaborative tangible interactions through a set of innovative stretchy sensors called eRopes. The system...
متن کاملMovie/Script: Alignment and Parsing of Video and Text Transcription
Movies and TV are a rich source of diverse and complex video of people, objects, actions and locales “in the wild”. Harvesting automatically labeled sequences of actions from video would enable creation of large-scale and highlyvaried datasets. To enable such collection, we focus on the task of recovering scene structure in movies and TV series for object tracking and action retrieval. We prese...
متن کامل3D Previsualization Using a Computational Photography Camera
During movie production, movie directors use previsualization tools to convey the movie visuals as they see them in their minds eye. Traditional methods of previsualization include hand-drawn sketches, storyboards and still photographs. Recently, video game engines have been used for previsualization so that once the movie set is modeled, scene lighting, geometry, textures and various scene ele...
متن کاملMusic control from 3D motion capture of dance
Research is currently being conducted at the University of California Irvine to develop novel approaches in music performance and composition generated from dancer’s gestures. We report here specifically the modification of the “Vicon 8” motion capture system to control digital music. This system allows for the capture of a dancer’s movement in 3D. Software is being developed, in the “Max/MSP” ...
متن کامل